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Abstract 

Job task analyses provide a link between job performance and examination content. This 
paper describes a methodology that utilizes Item Response Theory to place job task 
analysis data on an equal interval scale that allows for quantitative comparisons between 
tasks and provides a method for quantifying a test blueprint. An actual analysis was 
conducted; items with the highest calibrations on the latent variable received the highest 
relative percentage of test items, and items with the lowest calibrations received the 
lowest percentage of test items. Where job content must be closely tied to a predictive 
instrument for purposes of making informed personnel decisions, the rating scales 
derived from this method are more advantageous than ones derived from raw scores. 
Others may adapt this methodology to create similar instruments to be used for purposes 
other than the one shown. 
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Job Task Analysis: An IRT Application 

Job task analyses, also known as audits of practice, practice analyses, task 
analysis inventories, or role delineation studies, are used to validate examinations by 
providing a link between job performance and examination content (AERA, APA, & 
NCME, 1985; EEOC, CSC, DOL, & DOJ, 1987; Guion, 1998; Kane, 1997; SIOP, 1987). 
Job task analyses help ensure that exam content specifications are current and relevant. 

This paper proposes using an IRT rating scale analysis for job task analyses where 
the data on frequency and/or criticality of tasks or roles are collected using a Likert-type 
survey instrument. With this type of analysis, a linear scale is constructed that allows for 
consistent quantitative comparisons between tasks and provides a method for quantifying 
a test blueprint. The research presented herein extends previous work by one of the 
authors. 

Theoretical Framework 

The widespread use of job task analysis inventories today can be traced to 
research conducted by the U.S. Air Force (e.g., Morsh, 1964). Although originally used 
in the militar)', Harvey (1991, p.72) notes that “standardized job analysis questionnaires 
. . . have increased dramatically in number and popularity,” particularly in the private 
sector. Perhaps one important reason for this method’s increased popularity and use is 
that it lends itself nicely to job content validation (Gatewood & Feild, 1994). 

Classical analysis of job task analysis data attempts to scale tasks on a 
hypothetical construct of interest (Crocker & Algina, 1986; Banerji, Smith & Dedrick, 

1 997). Tasks are placed on a continuum based on raw score averages obtained by 
arbitrarily assigning quantitative numbers to qualitative response categories (Not 
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Important=l, Somewhat important=2, Important=3, Extremely important=4). However, 
using raw score averages to quantify the latent construct is inadequate because of the 
non-linearity of the scale (Linacre, 1999; Michell, 1990). For numbers to represent 
amounts and enable quantitative comparisons, a linear scale must be developed in which 
the difference between respondents, the difference between items, and the difference 
between response categories can be compared. 

The Rasch rating scale model (Wright & Masters, 1982) estimates the probability 
that a survey respondent will respond to a particular item with a particular response 
category as; 

log[Pnij/PniO--l)] ~Bn-D,-Fj 

where Pn,j is the probability of respondent n scoring in category j of item i; Pmo-i) is the 
probability of respondent n scoring in category j-1 of item i; is the measure of 
respondent n; D, is the difficulty of item i and Fj is the difficulty of step). The unit of 
measure is the logit (log-odds unit) and the difficulty of an item is the logit value on the 
scale. 

Rating scale categories are ordered "steps." If a respondent endorses an extreme 
statement, we expect her to endorse all less extreme statements. When four ordered 
levels are identified in an item, it can be thought of as having three steps (Figure 1): 

Insert Figure 1 about here 

A task on a role delineation study list can only be endorsed as "Important" if the first step 
from "Not Important" to "Somewhat Important" has also been endorsed. Thus the 
respondent who chooses "Important" can be considered to have chosen "Important" over 
"Somewhat Important" and "Not Imponant." For a three step item, the Rasch rating scale 



Job Task Analysis: An IRT Application 5 



models the probability of a respondent choosing a 4 rather than a 3, a 3 rather than a 2, a 
2 rather than a 1 . 

While the rating scale model assumes a fixed set of rating points across items, it 
does not assume a fixed interval between the response categories. This is in contrast to 
using raw score points where the arithmetic difference between a 4 and a 3 is the same as 
the difference between a 3 and a 2. Using arbitrarily assigned raw scores assumes that 
the intervals between each of the qualitatively defined response categories (Not Important 
to Somew'hat Important) are equal. 

When the Rasch rating scale model is used to analyze job task data, a linear scale 
is constructed that enables actual quantitative comparisons betw'een persons, items, and 
response categories. The difficulty of each item and the difficulty of each step are 
estimated on the same scale as the estimation of person measures. 

Method 

Data 

Data consisted of responses from 427 individuals in a nursing subspecialty who 

responded to the role delineation study. One hundred sixty-one nursing intervention 

tasks were rated on frequency and criticality. The first scale allowed respondents to 

indicate how frequently they performed a specific nursing intervention and included the 

following response options; 

A Several times per day 

B About once a day 

C About once per week 

D About once per month 

E Rarely, if at all 

The criticality scale allowed respondents to indicate tlie importance of the intervention; 

A Extremely important 

B Important 
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C Somewhat important 

D Not important 

Procedure 

The first step for the job task data analysis was to determine the sufficiency of the 
data to construct latent variables based on frequency of performance of an item, criticality 
of an item, or both. This was accomplished by analyzing the data using the Rasch rating 
scale model and the computer software program BIGSTEPS (Linacre, 1997). Two linear 
scales were constructed, representing the latent variables along which the items were 
placed based on their relative frequency or criticality. 

After the linear scales were created, it was necessary to identify those traits that 
might be eliminated from consideration in constructing the desired latent variables. 

Tasks were ordered based on their frequency and criticality as determined by the item 
calibrations. Then the two sets of calibrations were plotted against each other. Items that 
were seen infrequently and/or were determined to be non-critical could be removed from 
consideration for the test blueprint. Items that exhibited misfit were also identified and 
reviewed for possible elimination from the test blueprint. 

The data were examined for violations of the assumption of unidimensionality, a 
necessary step since Rasch rating scales are, by definition, unidimensional. Linacre 
(1998) has argued that following a Rasch analysis with a principal components analysis 
of the standardized residuals is preferred for determining multidimensionality. (The 
residual used here is the standardized difference between the observed response and the 
model expected response.) Thus, unrotated principal components analyses of the 
standardized residuals were conducted on the frequency and criticality responses, and 
resulting Eigenvalues were used to construct scree plots. 
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The final step was the construction of an examination blueprint identifying the 
content composition of the examination. A linear transformation of the frequency and/or 
criticality ratings convens the calibration of an item on the latent variable into a 
percentage of questions on an examination, so that items receiving a higher calibration 
are also assigned a higher percentage of questions on the test. 

Results 

Initial analysis of the frequency scale indicated that respondents were not using 
the entire five-point rating scale in a consistent manner (Figure 2). The inconsistency 
arose in the use of rating points 1 versus 2 and 3 versus 4. Basically, categories 3 and 4 
were not being selected. The inconsistency was resolved by collapsing the five-point 
scale into a three-point scale in which 1 represented “daily,” 2 represented “weekly or 
monthly,” and 3 represented “rarely.” Figure 3 shows the improved response probability 
curves after the scale was collapsed. 

Insert Figure 2 about here 

Insen Figure 3 about here 

Analysis of the criticality scale indicated that respondents used the four-point 
rating scale in a satisfactory manner. However, they tended to use the “3” rating scale 
point, which represented “somewhat important” less frequently than other categories. 
They usually rated items as either “very important,” “important,” or “not important.” 

Figure 4 shows the frequency scale plotted against the criticality scale. Those 
tasks in the upper right quadrant are frequently seen and considered critical to practice. 




8 



Job Task Analysis: An IRT Application 8 



Those tasks in the lower left quadrant are infrequently seen and not deemed critical to 
practice by the respondents. 

Insert Figure 4 about here 

The frequency variable spanned about a 6-logit range (-3 to +3) with negative 
calibrations representing interv'entions rarely practiced and positive calibrations 
representing interventions frequently practiced. The criticality latent variable spanned 
about 4 logits (-2 to +2) with negative calibrations representing unimportant items and 
positive calibrations representing extremely important items. 

A scree plot (Figure 5) constructed from the principal components analysis of the 
frequency residuals indicated the presence of two additional factors, and another for the 
criticality residuals (Figure 6) indicated the presence of one additional factor. (While the 
Kaiser [1960] criterion would have led to the retention of additional factors for both 
principal components analyses, closer examination of the items within those additional 
factors failed to discern a meaningful pattern.) Closer inspection of the items comprising 
both first residual factors (frequency and criticality) indicated they were bipolar (refer to 
Stevens [1996] for a more detailed discussion), with a basic care orientation on the 
positive end and an education/counseling orientation on the negative end (Tables 1 - 4). 
The second residual factor (frequency only, accounting for 5% of the total variance) was 
also bipolar, and closer examination of items comprising this factor indicated a 
monitoring or measurement and interpretation orientation on the positive end and a self- 
care or nursing care orientation on the negative end (Tables 5-6). Although these factors 
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were present, they were determined to be facets within their respective dimensions rather 
than additional dimensions. 

Insert Figure 5 about here 
Insert Figure 6 about here 
Insert Table 1 about here 
Insert Table 2 about here 
Insert Table 3 about here 
Insert Table 4 about here 
Insert Table 5 about here 
Insert Table 6 about here 

Subject matter experts reviewed these results. On the frequency and criticality 
scales, items having calibrations that fall below about -.50 on either or both scales are 
potential candidates for elimination from the examination blueprint. These are items that 
are infrequently encountered, unimportant, or both. In order to make this process more 
meaningful, subject matter expects reviewed criticality and frequency of tasks by content 
areas. They also reviewed items identified as misfitting. Figure 7 and Table 7 show the 
distribution of the content area “Perioperative care.” Subject matter experts reviewed the 
data and decided to delete task 66, “Surgical Assistance,” from consideration for the test 
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blueprint. This process was repeated for each content area. Following the removal of 
tasks, the remaining items were recalibrated. 

Insert Figure 7 about here 

Insert Table 7 about here 

Once tasks that were considered to be “Not Important” and “Infrequently seen in 
Practice” were eliminated from consideration for the test blueprint and the remaining 
items were recalibrated, the decision had to be made regarding quantification of the test 
blueprint. The test blueprint could be derived from (a) the frequency scale only, (b) the 
criticality scale only, or (c) some combination of the frequency and criticality scales. In 
this particular case, subject matter experts decided to base the test blueprint on the 
frequency scale. The criticality scale was not used because of the high correlation 
between the frequency and the criticality scales. 

Frequency calibrations are transformed to relative percentage of questions on the 
examination using a procedure developed by Lunz, Stahl and James (1989). This 
methodology allows for the development of two equations structured as linear 
transformation equations with two unknowns. The equations are solved for the slope and 
intercept constants; 

Y = A + BX (1) 

where 

Y = transformed percent of items from the Rasch calibrations of frequency 

X = Rasch calibration for the frequency of each Nursing Intervention 

A = Intercept constant 

B = Slope constant 
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Once these two constants are known, a standard linear transformation formula is 
used to transform the item calibrations into relative percentages. Initially, the highest 
calibration is arbitrarily assigned 5% of the test and the lowest calibration is assigned 1%. 
The calibrations from this particular data appear in Table 8, below: 

Insert Table 8 about here 

The two simultaneous equations are set up as follows: 



Y1=A + X1B or .05 = A + 1.95B (3) 

Y2 = A + X2B or .01 =A- 1.65B (4) 

The two constants in the simultaneous equations are solved using the following 
equations: 

A = (Y2- Y1)/(X2-X1) (5) 

B = Y1-((Y2-Y1)/(X2-X1))*X1 (6) 



Applying these equations to the Nursing Intervention Classification Code Items yields; 

A = .01111 
B = .02833 

This ensures that the item having the highest calibration on the latent variable receives 
the highest relative percentage of items on the test and the item having the lowest 
calibration receives the lowest percentage of items on the test. 

Because of the large number of items on each variable, the total of the 
transformed percentages will generally not equal 100%. A correction factor is calculated 
and applied to each of the transformed percentages. The correction factor rescales the 
percentages in a way that maintains the relative percentages, but ensures that the total 
percentage on the test equals 100%. 




R= 1 /Z Y 



( 7 ) 
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R = Correction factor to be applied to the transformed percent of items 
Y = Transformed percent of items from the Rasch calibrations of frequency 

S Y = 4.28 
R = .23364 

Table 9 shows the final test blueprint for Nursing Interventions. Subject matter 
experts will use the test blueprint to balance their item bank and develop tests that reflect 
nursing practice. 

Insert Table 9 about here 
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Discussion 

Items are the operational definition of the latent trait. The more the items are spread 
across the range of person trait estimation, the better the definition of the trait variable. 
Using an IRT rating scale model places job task analysis data on a scale of equal interval 
units. Also, IRT rating scale models can account for missing or non-represented data 
(e.g., only "smart" respondents answer, etc). This is because IRT rating scale models 
generate item calibrations that are person- and test- free (refer to Wright & Masters [1982, 
p.6], or Lord [1980, pp. 34-38] for a detailed discussion). And finally, when job task 
analysis data are scaled in equal interval units and missing data are taken into account, 
the test can be balanced to ensure that items with the highest calibrations on the latent 
variable receive the highest relative percentage of items on the test, and the items with the 
lowest calibrations receive the lowest percentage of items on the test. This property is 
not possible when raw scores alone are used to analyze the data. 

These kinds of measurement improvements help strengthen confidence in the link 
between the predictor measure and the predictor construct in Figure 8 below (Binning 
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and Barrett [1989]; Guion [1998]). Binning and Barrett (1989) note that "...a single 
experiment carmot validate all four inferences simultaneously." However, they cite the 
contention that we can have confidence that a test validly measures a construct if "...(I) 
the domain of the other construct is well defined and (2) the assumption of a relationship 
between the two constructs is inarguable" (Nurmally & Berstein [1994, p.92], as 
originally appearing in Nunnally [1978]). The method described in this paper directly 
supports the first point. For the second point, we must rely upon subject matter experts. 
While not addressed in this paper, it is hoped that other efforts would be made to 
construct and validate a criterion measure, and then correlate it with the predictor 
measure, further strengthening the predictor-measure to criterion-construct link. 

Insert Figure 8 about here 

For the particular instrument described herein, plotting the criticality scale against 
the frequency scale allowed subject matter experts to determine what tasks are both 
critical and frequently seen, and enabled them to make informed decisions about content 
specifications for their certification examination. These decisions were carried into the 
test building process by translating the IRT calibrations into relative percentages of items 
on the exam. Thus, performing a job task analysis using the IRT rating scale model 
produced a test blueprint more representative of the profession studied. Others may 
choose to adapt this methodology to create similar instruments to be used for purposes 
other than licensure and certification (e.g., persormel selection). Where actual job content 
has to be tied as closely as possible to a predictive instrument for purposes of making 
informed personnel decisions, the method presented herein is more advantageous than 
previously used methods with rating scales derived using raw scores. 
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Table 1. Frequency First Factor Positive Loadings 



Factor 


Item Diff 


Entry 


Loading 


in logits 


Order 


0.62 


0.95 


70 


G.62 


1.21 


53 


0.60 


0.77 


71 


0.58 


1 . 12 


52 


0.57 


1.01 


69 


0.54 


0.51 


62 


0.54 


0.63 


75 


0.53 


0.44 


74 


0.52 


0.70 


40 


0.51 


0.73 


76 


0.50 


0.76 


42 


0.50 


0.63 


41 


0.43 


0.18 


64 


0.47 


0.08 


91 


0.47 


0.23 


38 


0.46 


-0.06 


90 


0.46 


0.16 


86 


0.45 


0.52 


58 


0.45 


0.49 


80 


0.45 


0.13 


39 


0.4 4 


0.57 


55 


0.43 


0.40 


61 


0.43 


0.19 


92 


0.43 


0.33 


78 


0.42 


0.32 


88 


0.41 


0.06 


89 


0.41 


0.26 


68 


0.41 


0.58 


2 5 


0.38 


1.62 


56 


0.38 


1.15 


72 


0.37 


-0.09 


28 


0.36 


0.68 


59 


0.36 


0.53 


87 


0. 36 


0.97 


20 


0.34 


0.07 


79 


0.34 


0.02 


54 


0.34 


0.01 


29 


0.33 


-0.07 


138 


0.32 


-0.12 


84 


0.32 


0.53 


60 


0.31 


-0.21 


46 


0.31 


0.69 


19 


0.30 


1.0 9 


43 


0.30 


0. 16 


85 


0.30 


Q. 84 


130 



Item 

Content 

ll~Airway Suctioning 

9-Cerebral Perfusi on Promotion 
11 -Artificial Airway Manageimen 
9-Cerebral Edema Management 
11-Airway Management 

9- Tube Care: Ventr iculostomy/L 
11-Oxygen Therapy 
11-Mechanical Ventilation 
7-Electrolyte Management 

11- Respiratory Monitoring 

7 -Fluid/Electrolyte Management 
7-Electrolyte Monitoring 

10- Postanesthesia Ca re 
14-Shock Management: Vasogenic 
7 -Ac id- Base Managem.ent 
14-Invasive Hemodynamic Monito 
14-Dysrhthmia Management 
S-Positioning: Neurologic 

12 - Pres sure Ulcer Prevention 

7- Acid-base Monitoring 
9-Intr acranial Pressure (ICP) 
S-Subarachnoid Hem.orrhage Prec 
14 -Shock Prevention 
12-Pressure Management 
14-Fluid Managem.eni 
14-Fluid Resuscita lion 

11- Airway Insertion and Stabil 
4-Enteral Tube Feeding 
9-Neurologic Monitoring 

11- Aspiration Precautions 
4-Total Parenteral Nutrition 
9 -Seizure Management 

1 4 -Embolus Precautions 

3- Positioning 

12- Pressure Ulcer Care 
9-Dysref lexia Management 

4- Tube Care; Gastrointestinal 
20-Physical Restraint 

13- Temperature Regulation 
9 -Seizure Precautions 

8 - Conscious Sedat ic;n 
3-Bed Rest Care 
8-Analgesic Admini5:tration 

14- Bleeding Precaut ions 
1 9-Resuscitat ion 
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Table 2. Frequency First Factor Negative Loadings 



Factor 


Items Diff 


Entry 


Loading 


in logits 


Order 


-0.58 


-0.4 9 


93 


-0.57 


-0.17 


109 


-0.56 


-0.16 


110 


-0.53 


-0.64 


lOS 


-0.53 


-0.75 


119 


-0. 52 


-0.64 


94 


-0.51 


-0.76 


115 


-0.51 


-0.19 


160 


-0.51 


-0.17 


116 


-0 . 50 


0.10 


117 


-0.49 


-1.21 


143 


-0.48 


-0.40 


105 


-0 . 4 6 


-0.26 


107 


-0.45 


0.20 


157 


-0.45 


0.11 


140 


-0.45 


-0.59 


106 


-0.44 


-0.94 


145 


-G. 43 


-0.13 


122 


-0.43 


-1.04 


95 


-0.42 


0.33 


120 


-0.41 


-0.68 


123 


-0.41 


0.02 


139 


-0.41 


0.28 


124 


-0.3 9 


-1 . 47 


112 


-0.39 


-0.75 


126 


-0.38 


0.27 


142 


-0.38 


0.64 


118 


-0.38 


-0.80 


104 


-0.38 


0.09 


159 


-0.37 


-0.21 


128 


-0.37 


-0.16 


4 


-0.36 


-1.28 


127 


-0.36 


-0.81 


101 


-0.35 


-0.52 


158 


-0.34 


-0.25 


153 


-0.32 


-1.35 


97 


-0.32 


-0.34 


103 



Item 

Content 

15-Activity Therapy 
17 -Coping enhancement 
17-Counseling 

17 - Body Image Enhancement 

18- Teaching Group 

15- Behavior Management 
17-Support Group 
24-Referral 

17- Support System Enhancenent 

18- Health Education 

21-Home Maintenance Assistance 

16- Communication Enhancemsent : 

17- Anticipatory Guidance 
24-Health Care Information Sxc 
2 1 -Caregiver Support 

16- Communication Enhancemsent: 
21-Respite Care 

IS-Teaching: Prescribed Activi 

15- Behavior Management ; Overac 

18- Teaching: Individual 
18-Teaching: Prescribed Diet 

20- Risk Identification 
18-Teaching: Prescribed Medica 

17 - Sexual Counseling 

18- Teaching: Psychomotor Skill 

21- Family Involvement 

18- Teaching Disease Process 

1 6- Communication Enhancement : 
24-Multidisciplinary Care Conf 

19- Crisis Intervention 
1-Exercise Therapy: Balance 
18-Teaching : Sexuality 
16-Memory Training 
24-Health Policy Monitoring 
23-Quality Monitoring 

15- Behavior Management: Sexual 

16- Communication Enhancem.ent 
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Table 3. Criticality First Factor Positive Loadings 



Factor 


Item Diff 


Entry 


Loading 


in legits 


Order 


0.75 


0 . 66 


75 


0.69 


0.31 


70 


0.69 


0.44 


25 


0 . 63 


0.91 


20 


0.65 


0.56 


7 6 


0.63 


0.71 


19 


0. 63 


0.47 


12 


0.62 


0.67 


78 


0.62 


0.12 


71 


0.59 


0.32 


69 


0.53 


0.63 


88 


0.57 


0.56 


40 


0.56 


0.59 


72 


0.54 


0.60 


80 


0.53 


0.59 


42 


0.51 


0.21 


38 


0.50 


0.23 


29 


0 . 50 


-0.10 


7 4 


0.50 


0.17 


133 


0.48 


0.21 


39 


0.48 


0.57 


41 


0.47 


0.56 


34 


0.46 


0.4 9 


24 


0.44 


0.39 


27 


0.43 


-0.61 


92 


0.4 3 


0.59 


155 


0.42 


-0.35 


90 


0.42 


0.05 


86 


0.42 


0.62 


7 


0.41 


0.4 0 


32 


0.41 


0.31 


53 


0. 40 


-G. 67 


91 


0.40 


0.32 


84 


0.40 


-0.36 


28 


0.39 


-0.27 


89 


0.39 


0.54 


87 


0.39 


-0.56 


68 


0.38 


0. 30 


SI 


0.33 


-0.33 


62 


0.37 


0.21 


52 


0.36 


-0.17 


61 


0.36 


0.04 


82 


0,34 


-0.76 


130 


0.34 


1 . 17 


43 


0.32 


-0.25 


26 


0.31 


0.05 


64 


0.31 


0.18 


73 


0.30 


-0.03 


11 


0.30 


0.56 


77 



Item 

Content 

11-Oxygen Therapy 

11-Airway Suctioning 
4-Enteral Tube Feeding 

3- Positioning 

11- Respiratory Moritoring 
3“Bed Rest Care 

2 -Tube Care : Urinary 

12- Pressure Management 
11-Artificial Airway Managemen 
11-Airway Management 
14-Fluid Management 

7 -Elect roly te Management 

11- Aspiration Precautions 

12- Pressure Ulcer Prevention 

7 -Fluid/Electrolyte Management 
7-Acid-Base Managem^ent 

4- Tube Care: Gastrointestinal 
11-Mechanical Ventilation 
20-Physical Restraint 
7-Acid-base Monitoring 

7- Electrolyte Monitoring 
6-Oral Health Maintenance 
4-Feeding 

4 -Nutrition Therapy 
14 -Shock Prevention 
23-Technology Management 
14-Invasive Hemodynamic Monito 
14-Dysrhthraia Management 
2-Bowel, Incontinence Care 
6-Bathing 

9-Cerebral Perfusion Promotion 
14-Shock Management: Vasogenic 

13 - Temperature Regulation 
4-Total Parenteral Nutrition 

14- Fluid Resuscitation 
14-Embolus Precaut ions 

11- Airway Insertion and Stabil 

12- Skin Care: Topical Treatmenent 
9-Tube Care ; Ventriculostomy 
9-Cerebral Edema Management 

9- Subarachnoid Hemorrhage Prec 

13- Fever Treatm-ent 
1 9-Resuscitation 

8 - Analgesic Administration 

4 -Gastrointestinal Intubation 

10- Postanesthesia ('are 

11- Cough Enhancement 

2 -Diarrhea Managemtmt 

12- Incision Site Care 
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Table 4. Criticality First Factor Negative Loadings 



Factor 


Item Diff 


Entry 


Loading 


in logits 


Order 


-0.65 


0.02 


160 


-0.65 


0.41 


124 


-0.60 


0. 17 


110 


-0.60 


0.17 


109 


-0.59 


0.40 


117 


-0.59 


0.17 


140 


-0.58 


0.33 


157 


-0.56 


0.02 


93 


-0.55 


-0.74 


119 


-0.55 


0.26 


122 


-0.53 


-0.28 


94 


-0.53 


-0.82 


115 


-0.52 


0.52 


120 


-0.52 


-0.28 


108 


-0.50 


-1.24 


143 


-0.49 


0.88 


118 


-0.49 


-0.05 


107 


00 

o 

1 


-1.30 


145 


1 

o 

CO 


0. 13 


116 


o 

1 


-1.28 


144 


MO 

o 

1 


-0.02 


159 


-0.43 


-0.39 


128 


-0.42 


-1 . 65 


112 


-0.42 


0.41 


142 


-C.40 


-0.64 


95 


-0.40 


0.49 


125 


-0.39 


-1.32 


127 


-0.39 


-0.29 


158 


-Q.38 


1 

o 

o 


126 


-0.38 


-1.07 


141 


-0 . 37 


0.82 


43 


-0.37 


-0.33 


123 


-0.34 


-1.24 


131 


-0.34 


-0.33 


65 


-0.33 


-0.4 6 


149 


-0.31 


-C. 42 


106 


-0.31 


0.30 


4 


-0. 30 


-0.11 


153 


-0.30 


0.35 


139 



Item 

Content 

24-Referral 

18-Teaching: Prescribed Medica 
17-Counseling 

17- Coping Snhanceiaent 

18- Health £ducati(:>n 
2 1-Ca regiver Support 
24-Health Care Information Exc 
15-Activity Therapy 
18-Teaching Group 
18-Teaching: Prescribed Activi 
15-3ehavior Management 

17- Support Group 

18- Teaching: Indi\ idual 

17- 3ody Image Enhancement 
21-Home Maintenance Assistance 

18- Teaching Disease Process 
17-Anticipatory Guidance 
21-Respite Care 
17-Support System Enhancement 
21-Normalization Promotion 
24-Multidisciplinary Care Conf 

19- Crisis Intervention 

17 - Sexual Counseling 
21-Family Involvement 

1 5- Behavior Management ; Overac 

18- Teaching ; Procedure/Treatme 
1 8-Teaching : Sexuality 
24-Health Policy Monitoring 

18 -Teaching : Psychomotor Skill 
2 1 -Developmental Enhancement 
8-Medication Management 
18 -Teaching ; Prescribed Diet 

20- Abuse Protection: Elder 
10 -Preoperative Coordination 
2 3- Peer Review 

1 6- CoiTimunication Enhancement : 
1-Exercise Therapy: Balance 
23-Quality Monitoring 
20-Risk Identification 
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Table 5. Frequency Second Factor Positive Loadings 



Factor 


Item Diff 


Entry 


Loading 


in logits 


Order 


0.62 


-0.35 


90 


0.55 


-0.29 


55 


0.55 


-0.10 


74 


0.48 


-0.42 


46 


0.47 


-0.56 


68 


0.44 


-0.33 


62 


0.42 


-0.27 


89 


0.41 


-0.61 


92 


0.40 


-0.67 


91 


0.40 


-0.76 


130 


0.37 


-0.17 


61 


0.36 


0.31 


53 


0.34 


0.21 


52 


0.34 


-1.07 


129 


0.30 


0.21 


39 



Item 

Content 

14-Invasive Hemodynamic Monitor 
9-Intracranial Pressure (ICP) 
11-Mechanical Ventilation 

8 - Conscious Sedation 
11-Airway Insertion and Stabil 

9- Tube Care: Ventri culostomy/L 
14 -Fluid Resuscitation 

14 -Shock Prevention 
14-Shock Management: Vasogenic 
1 9-Resuscitation 
9-Subarachnoid Hemorrhage Prec 
9“Cerebral Perfusion Promotion 
9-Cerebral Edema Management 
19-Organ Procurement 
7-Acid-base Monitoring 
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Table 6. Frequency Second Factor Negative Loadings 



Factor 


Item Diff 


Entry 


Loading 


in logits 


Order 


-0.57 


0.29 


17 


-0.54 


0.36 


35 


-0.54 


-0.44 


16 


-0.53 


0.28 


37 


-0.53 


0.00 


15 


-0.53 


-0.09 


18 


-C.51 


-0.19 


14 


-0.50 


0.33 


8 


-0.49 


0.01 


21 


-0.47 


-0.30 


9 


-0.47 


0.62 


7 


-0.44 


-0.46 


13 


o 

0 

1 


0.62 


136 


-0.39 


-0. 10 


33 


-0.38 


0.30 


4 


-0.37 


0.49 


24 


-0.37 


0.60 


80 


-0.36 


0.30 


81 


-0.36 


0.56 


34 


-0.35 


0.67 


78 


-0.33 


0. 40 


32 


-0.33 


0.72 


5 


-0.33 


0.25 


10 


-0 . 32 


0.91 


20 


-0.30 


-0.33 


134 


-0.30 


0.06 


103 



Item 

Content 

2-Urinary Incontinence Care 
6-Self Care Assistence 
2~Urinary Habit Training 
6-Swallowing Therapy 
2-Urinary Elimination Manageme 
2-Urinary Retention Care 
2-Urinary Catherization : Inter 

2- Bowel Management 

3- Positioning : Wheelchair 
2-Bowel Training 
2-Bowel, Incontinence Care 
2-Urinary Bladder Training 
20-Fall Prevention 
6-Dressing 

1-Exercise Therapy: Balance 

4 - Feeding 

12-Pressure Ulcer Erevention 
12-Skin Care: Topical Treatmen 
6-Oral Health Maintenance 
12-Pressure Management 
6-Bathing 

1- Exercise Therapy: Joint Mobi 

2 - Constipation /Impact ion Manag 

3- Positioning 
20-Dementia Managenrent 
16-Comirtunication Enhancement 
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Table 7. Distribution of Content for Perioperative Care 


item Number 


Nursing Interventions 


F requency 


Criticality 






Calibration 


Calibration 


64 


Postanesthesia Care 


0.05 


0.22 


65 


Preoperative 

Coordination 


-0.59 


-0.35 


66 


Surgical Assistance 


-1.88 


-1.07 


1 

t 

i 


Surgical Preparation 


-0.41 


-0.35 
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TaWe 8. Values for Transfo rming Ite m Calibrations into R elative Percentages 



Item 


Rasch Calibration 


Percent 


Most Frequent 


XI = 1.95 


Jl 

O 


Least Frequent 


X2 = -1.65 


Y2 = 01 
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Table 9. Nursing Interventions Test Blueprint® 



Subarea 



Percent 



Elimination 8.01 

Immobility 3.61 

Nutrition 4.17 

Physical Comfort 0.95 

Self-care 4.36 

Electrolyte & Acid''Base 3.83 

Drug 4.22 

Neurologic 8. 1 0 

Perioperative 1.82 

Respiratory 6.46 

Skin/Wound 3.80 

Thermoregulation 1.72 

Tissue Perfusion 5.08 

Behavior 3.72 

Cognitive 3.72 

Coping 5.45 

Patient 7.27 

Crisis 1.35 

Risk 5.56 

Lifespan 2.80 

Health Systems 0.72 

Health Systems 5.66 

Information 3.79 

Total 100.15® 



®Note: total exceeds 100% because of rounding. 
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Figure 1. Example of step ordering for a four-level rating scale. 
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Figure 2. Analysis of the initial five-point rating scale for frequency. 
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Fiizure 3. Analysis of the final three-point rating scale for frequency. 



p 

R 

0 

B 

A 

B 

1 
L 
I 
T 
Y 



R 

£ 

S 

P 

O 

N 

S 

£ 



UAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA^, 



1.0 Allllllllll 



3 

3 

3 

A 

3 

3 

3 

A 



mill 



111 



11 



3333333333a 



333333 



333 



33 



3 

3 

A 

3 

3 

3 

A 



.5 A 



, 4 A 



3 

A 

3 

3 

3 



1 3 

1 3 

2 * 222*2 
2 13 2 

22 * 22 
2 3 1 2 



22 



22 



22 



22 



222 



33 



11 



222 



222222 



333 



A 

3 

A 

3 



A 

3 

3 



0 a**********333333333333 



111 222222 5 

111111111111* *********A 



aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaau 
“6 -4 -2 0 2 4 6 



Job Task Analysis: An IRT Application 28 



Figure 4. Frequency vs. criticality calibrations for nursing interventions. 
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Figure 5. Scree plot of the principal components of standardized frequency residuals. 
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Figure 6. Scree plot of the principal components of standardized criticality residuals. 
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Figure 7. Frequency vs. criticality calibrations for perioperative care. 
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Figure 8. Basic linkages in the development of a predictive hypothesis. Adapted from 
Guion, R.M. (1998). Assessment, measurement, and prediction for personnel decisions. 
Mahwah, NJ: Lawrence Erlbaum Associates. Originally appearing in Binning, J.F., & 
Barrett, G.V. (1989). Validity of personnel decisions; A conceptual analysis of the 
inferential and evidential bases. Journal of AoDlied Psychology, 74, 478-494. 
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